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ABSTRACT 

We report on early results from very deep and wide-field narrow-band imaging on a 543 arcmin 2 
area of the Subaru Deep Field. We find 87 Lyman a emitters (LAEs) at z = 4.86 ± 0.03 which are 
photometrically selected by a combination of two broad bands (R and i') and one narrow band (NB7U; 
X c = 7126A, AA = 73A). We derive the luminosity functions (LFs) of the LAEs at Lya luminosity 
and at UV-continuum (rest-frame 1700A) luminosity. The LFs show little evolution between z=3.4 and 
z=4.86 either in Lya or UV-continuum emission. The amplitude of the LAE LF tends to decline at the 
bright magnitudes more rapidly than that of the LBG LF at similar redshifts. We calculate the angular 
correlation function of our LAEs up to ~ 15 arcmin separations. The angular correlation u>(9) is found 
to increase with decreasing angular separations, showing a clear signal of clustering. It is also found that 
the distribution of LAEs shows a large density gradient with a scale of > 15 arcmin, which would indicate 
the existence of a large-scale structure of LAEs on > 20/i~ 1 Mpc scales. We fit the observed correlation 
function by A^O' - 8 to find A u = 29 arcsec 8 . The estimated correlation length is tq = 3.5^Q'g/i _1 Mpc 
in comoving units (O m = 0.3 and Qa — 0.7), which is slightly larger than the value for z ~ 4 LBGs with 
i' < 26. We calculate the angular correlation function for two sub-samples of the 87 LAEs divided by 
Lya luminosity, UV-continuum luminosity, and Lya equivalent width (EW) . The Lya-bright sub-sample 
shows a larger correlation amplitude than the Lya-faint sub-sample, while no significant difference is 
found for the sub-samples divided by UV-continuum luminosity or EW. This may indicate that galaxies 
with bright Lya emission are possibly biased against the underlying dark matter halos more strongly 
than those with bright UV continuum. 

Subject headings: cosmology: observations — cosmology: early universe — cosmology: large-scale 
structure of universe — galaxies: high-redshift — galaxies: evolution 



1. INTRODUCTION 

In the typical hierarchical clustering scheme of cold dark 
matter (CDM) models, sub-galactic clumps are formed 
from gravitational collapse of small initial density pertur- 
bations, and those clumps progressively merge and col- 
lapse to become galaxies of larger masses. Merging pro- 
cesses increase (decrease) the number density of bright 
(faint) galaxies, and enhance the clustering amplitudes of 
galaxies. The luminosity functions (LFs) and clustering 
properties of high-z (z > 2) galaxies are, thus, essential 



for understanding the galaxy formation. Recent observa- 
tional efforts at optical wavelengths have revealed two ma- 
jor classes of high-z galaxies which are suitable for study- 
ing LFs and clustering properties of distant galaxies. 

One class of high-z galaxies is Lyman break galaxies 
(LBGs; Steidcl ct al. 1996a) which arc selected by their 
UV-continuum features redshifted to optical wavelengths 
12 . Since LBGs are identified by their strong continuum 
break, they are generally limited to UV-continuum bright 
galaxies. Such bright high-z galaxies can be well investi- 
gated. The LF of LBGs at z ~ 3 (Steidel et al. 1999) has 
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a larger M* than that of the local UV-selected galaxies 
(Sullivan et al. 2000), but its normalization, <f>*, is compa- 
rable within a factor of two for the LBGs and for the local 
galaxies (see also Lowenthal et al. 1997). The apparent 
size of LBGs at z ~ 3 is 0".2-0".3 (1.0 - l.Gh^kpc for 
TO = 0.3 and Q\ = 0.7) in a half light radius (Steidel et 
al. 1996b). LBGs at z ~ 3 — 4 show stronger clustering 
than the underlying dark matter (Giavalisco et al. 1998; 
Ouchi et al. 2001a). A hint of mergers has been found for 
LBGs at z ~ 4 (Ouchi et al. 2001a). 

The other class of high-z galaxies is Lyman a Emitters 
(LAEs) which are identified by their redshifted Lya emis- 
sion with narrow-band imaging (Cowie & Hu 1998; Hu, 
Cowie, & McMahon 1998). LAEs are thus high- z galax- 
ies which have a relatively strong Lya emission whose 
rest- frame equivalent width, EW vcs t, is > 20A. Most of 
the detected LAEs tend to have fainter continua than 
LBGs (e.g., Cowie & Hu 1998; Hu, Cowie, & McMa- 
hon 1998; Steidel et al. 2000; Fynbo, Moller, & Thorn- 
sen 2001). The estimated number density of LAEs down 
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per unit z (Hu, Cowie, & McMahon 1998; Rhoads et al. 
2000). The size of LAEs at z = 2.4 is as small as < 0".l 
(< O.e/i^kpc for n m = 0.3 and il A = 0.7) in a half light 
radius (Pascarelle, Windhorst, Keel, & Odewahn 1996). 
An indication for a large scale structure formed by LAEs 
at z = 2.4 has been reported by Pascarelle, Windhorst, 
& Keel (1998) from a combination of their three blank 
field surveys, although other blind searches have not found 
such clumpy distributions (Rhoads et al. 2000). Searches 
of LAEs on targetted fields have found strong clustering 
of LAEs around quarars (Campos et al. 1999; M0ller & 
Fynbo 2001; Stiavelli et al. 2001), radio galaxies (Vene- 
mans et al. 2002), high redshift clusters (Palunas, Francis, 
& Woodgate 2000), and overdensities in the LBG distri- 
bution (Steidel et al. 2000). 

Since LAEs are fainter and smaller than LBGs and some 
LAEs have strong clustering, it is possible that LAEs 
are dominated by sub-galactic clumps which subsequently 
form massive galaxies. Indeed, Pascarelle, Windhorst, 
Keel, & Odewahn (1996) have proposed that LAEs are 
sub-galactic clumps. If high-z LAEs are dominated by 
sub-galactic clumps, the LF of LAEs is expected to show 
a steep decline toward the bright end. The clustering am- 
plitude of LAEs should be larger than that of LBGs on 
small scales (< 20kpc or < 5") where the correlation am- 
plitude is sensitive to the fraction of merging galaxies. 

In this paper, we report on luminosity functions and 
clustering properties of LAEs at z = 4.86, based on our 
deep (i' <~ 27) and wide-field (540arcmin 2 ) broad- and 
narrow-band imaging of the Subaru Deep Field. The un- 
precedentedly deep and wide-field imaging data enable us 
to investigate the LF of LAEs down to Mtjv ~ —18.5 and 
the clustering properties up to ~ 20 Mpc scales in comov- 
ing units. Throughout this paper, magnitudes are in the 
AB system, and all calculations assume a A-dominated 
spatially flat cosmology, H — 100ftkms -1 Mpc -1 , Q m = 
0.3, and n A = 0.7. 

2. OBSERVATIONS AND DATA REDUCTION 



As part of the Subaru Deep Field (SDF) project, deep 
and wide-field optical imaging of the SDF (13 h 24 m 21 s .38, 
+27°29'23".0[J2000]) was carried out during the commis- 
sioning phase of Subaru Prime Focus Camera (Suprime- 
Cam; Miyazaki et al. 1998) in March to June, 2001 (Shi- 
masaku ct al. in preparation). We obtained B-, V- 
, i?-, i'-, z'- and a narrow-band (NB711: centered at 
7126A) images of about a 600 arcmin 2 area of the SDF 13 . 
Figure la shows the transmittancc of R,i', and NB7U. 
The peak transmittance, central wavelength, and band 
width (FWHM) of NB7U are measured to be 0.83 ±0.01, 
7126 ± 4A, and 73.0 ± 0.6A, respectively. The errors indi- 
cate the rms measured at 13 positions evenly spaced over 
the surface of the filter. The data were reduced in the 
same manner as explained in Ouchi ct al. (2001a). The 
final images cover a contiguous 543 arcmin 2 area with a 
PSF FWHM of 0."90. The net exposure times of the fi- 
nal images are 210, 150, 90, 138, 81, and 162 minutes 
for B, V, R, i', z', and NB7U, respectively. The limit- 
ing AB magnitudes are B = 27.8, V = 27.3, R = 27.1, 
i' = 26.9, z' = 26.1, and NB7U = 26.0 for a 3cr detec- 
tion on a l."8 diameter aperture. Source detection and 
photometry are performed using SExtractor version 2.1.6 
(Bertin & Arnouts 1996). The AB711-band frame is cho- 
sen to detect objects, and we limit the object catalog to 
NB711 < 26.0, in order to provide a reasonable level of 
photometric completeness. 

3. PHOTOMETRIC SAMPLE OF Z — 4.86 LYa EMITTERS 

Our catalog contains 30,297 objects with NB711 < 26.0 
in total. Figure 2 shows the color magnitude diagram of 
the detected objects. Since the NB711 band measures 
fluxes between the R and i' bands (see Figure la), we 
define the off-band continuum flux of objects as Ri = 
(R + i')/2. We determine the selection criteria which iso- 
late LAEs at z = 4.86 ± 0.03 from foreground objects, on 
the basis of expectations from SEDs of model LAEs, fore- 
ground galaxies, and Galactic stars (left panel of Figure 3; 
see the figure caption for the details). We regard an object 
as a LAE when it satisfies the following selection criteria 
simultaneously, 



Ri - NB711 > 0.8, 
R-i' > 0.5, 
i' - NB711 > 0. 



(1) 
(2) 
(3) 



The first criterion corresponds to an equivalent width 
(EW) to be > 82A in the observed frame ( > 14A in the 
rest frame at z = 4.86) 14 . The second criterion rejects 
low- 2 objects with strong emission lines of Ha, [OIII], and 
[Oil] etc. Since the Lya continua of high-z objects are ab- 
sorbed by neutral hydrogen of the inter-galactic medium 
(IGM), i?-band fluxes are expected to be weaker than i'- 
band fluxes for z = 4.86 objects. Figure 3 demonstrates 
that this criterion efficiently rejects low-z emitters but se- 
lects z = 4.86 galaxies whose IGM absorptions are stronger 
than 0.5 T e g, where T e s is the median opacity of the IGM 
given by Madau (1995). The third criterion is placed to re- 
ject break objects whose spectra have a spectral trough on 

13 The central 4 arcmin 2 region of SDF has ultra-deep J and K' data (Maihara et al. 2001) 

14 For simplicity, we calculate EW from Ri — NB711 alone, without correcting for R — i color. 
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the bluer side of the iVi?711-band. This trough is misiden- 
tified as an emission feature by Ri — NB7W color. These 
three criteria collectively select LAEs at z = 4.86 with a 
low contamination from low-z interlopers. 

There 3X6 3 total of 87 objects that meet all the crite- 
ria simultaneously down to NB711 = 26.0 and i' — 27.8, 
where i' — 27.8 is the 1.3cr limiting magnitude of the i' 
band. The color criterion, R — i'> 0.5, can be securely im- 
posed on objects detected over a 3a level in i' (i' = 26.9) by 
using their R magnitudes or a 2a upper limit (R — 27.6). 
Among the 87 selected objects, 62 objects brighter than 
i' = 26.9 have a secure R — i' > 0.5 limit. Remaining 
25 (= 87 — 62) objects with i' > 26.9 have large errors 
in R — i' color, and thus the contamination by foreground 
objects will be higher than for the bright objects. How- 
ever, in order to enlarge our sample, we do not remove 
these faint objects from our LAE sample, and insted es- 
timate the contamination and completeness for the whole 
sample as a function of apparent magnitude on the basis 
of Monte Carlo simulations which take account of photo- 
metric errors. Our photometric sample of z — 4.86 LAEs 
comprizes these 87 objects. These LAEs are shown by 
large red points in Figure 2. 

In Figure 2, some objects seem to have absorption fea- 
tures at significant levels. We do not know the detail 
spectral features of those objects, but for simplicity we 
call those objects with absorption features "absorbers". 
We define as absorbers those having Ri — NB711 < —0.6 
and Ri - NB711 < -0ANB711 + 9.6 (yellow line in Fig- 
ure 2), and find 37 absorbers. We investigate the SEDs 
of the 37 absorbers from BVRi'z' multi-color data. Fif- 
teen objects show a good agreement with stellar spectra, 
and eight objects are consistent with late-type galaxies. 
However, the nature of the remaining fourteen objects is 
uncertain. Their spectra marginally agree with spectra 
of low-z galaxies or Galactic objects. They may be vari- 
able objects and/or moving objects (such as Kuiper-belt 
objects). Future spectroscopic follow-up observations will 
reveal the nature of those objects 15 

We have estimated photometric contamination and com- 
pleteness of the LAE sample. Since the sample construc- 
tion is based on NB711, R, and i' images, we estimate 
the completeness and contamination by Monte Carlo sim- 
ulations using real R-,i'-, and A^i?711-band images. To 
estimate the contamination, we generate 30, 297 objects 
that mimic all the detected objects with NB711 < 26, 
and distribute them randomly on our original images after 
adding Poisson noises according to their original bright- 
ness. Then, we detect these simulated objects and mea- 
sure their brightness. The contamination of our sample is 
defined by the ratio of the objects that did not pass the cri- 
teria in the original data but satisfy the criteria in the sim- 
ulated data, to the number of all the original objects which 



passed the criteria. We iterate this process 10 times and 
estimate the ratio of contamination as a function of i' mag- 
nitude. We find the sample contamination to be 40%. We 
calculate the completeness of LAEs as a function of con- 
tinuum {%') magnitude, not as a function of NB711 magni- 
tude, since we want to derive the rest-frame UV-continuum 
luminosity function of LAEs (see section 4). We need to 
take two kinds of incompleteness into account; one is the 
incompleteness of i'-band detection, and the other is the 
incompleteness due to our sample being iV£>711-limited. 
The latter incompleteness is equivalent to missing small- 
EW emitters of faint i' magnitudes 16 . To estimate the 
completeness (the sum of the above two sources) , we make 
a subsample composed of 45 LAEs with i' < 26.5, whose 
continuum flux and EW (or Ri — NB711 color) are fairly 
accurately measured. This i'-limited subsample is essen- 
tially complete in terms of EW (or Ri — NB711 color). 
Assuming that the R — i' vs. Ri — NB711 color distribu- 
tion found for the objects in this subsample is universal, 
i.e., irrespective of i' magnitude, we make a mock cat- 
alog of 360 (= 45 x 8) LAEs whose i'-band magnitudes 
are scaled from i' = 24.5 to i' = 27.5 into 0.5 magnitude 
bins. We perform Monte Carlo simulations with 360 arti- 
ficial LAEs in the same manner as for the contamination 
estimation. We define here the completeness of LAE sam- 
ple as the number of the simulated objects which again 
pass the selection criteria divided by all the original ob- 
jects which passed the criteria. We repeat this simula- 
tion 100 times, and average the measured completenesses. 
The completeness weighted by the number of the detected 
objects are found to be 40% 17 . When deriving the UV 
luminosity function in section 4, we correct the data for 
the contamination and completeness derived in this way. 
The completeness correction derived here is valid if the 
color distribution of LAEs does not change largely with 
apparent i' magnitude. 

In order to examine how well eqs. (l)-(3) can select 
z = 4.86 galaxies, we examine what fraction of LAEs sat- 
isfy continuum break selection criteria for z ~ 5 LBGs. 
On the basis of expectations from GISSEL96 (Bruzual & 
Chariot 1993) population synthesis models, we define the 
criteria for z ~ 5 LBGs as V — i' > 1.8, i' — z' < 0.7, and 
V — i' > 2.0 x (i' — z') + 1.4, which isolate z ~ 5 galaxies 
from low-z galaxies and Galactic stars ( Ouchi et al. in 
preparation; see also Ouchi et al. 2001b). Since most of 
our LAEs have faint continuum magnitudes (i.e., i' ~ 27), 
the number of LAEs to which the LBG selection criteria 
can be reliably applied is very limited. This is because the 
LBG selection criteria require very deep V magnitudes rel- 
ative to i' magnitudes. The limiting magnitudes of our V 
data are ~ 27.8 in a 2a level, and thus the LBG criteria can 
be safely applied only to galaxies brighter than i' ~ 26.0. 
We have nine LAEs brighter than i' = 26, and find that 



15 Our on-going spectroscopic obaservations have revealed that one absorber is a z = 0.58 galaxy with a very blue continuum and strong [OIII] 
emission lines in the i'-band. 

16 In terms of -Wi^ll-dcpcndent incompleteness, our iV.B711-limited sample of LAEs may miss l&rge-EW emitters of faint NB711 magni- 
tudes, since the limiting magnitude of NB711 and i 1 for our sample selection is NB711 = 26.0 and i' = 27.8. This implies that objects with 
i' — NB711 > 2 will not be included in the sample at the faintest NB711 magnitudes (NB711 ~ 26.0). Since we cannot determine a subsample 
which is complete in terms of emission luminosity, wc do not calculate completeness as a function of emission luminosity in our analysis. 

17 These values of contamination and completeness include photometric errors only, and do not include any systematic errors. The systematic 
errors may be caused from (l)low-z interlopers satisfying the selection criteria and (2)the photometric errors of input objects themselves by 
which the observed color distributions arc wider than the real distributions in the Ri — NB7U vs. R — i' plane. More reliable contamination 
and completeness estimations can, however, be obtained only with spectroscopic follow-up observations. 
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five out of the nine to pass the LBG criteria, implying that 
the contamination of our LAE sample by foreground ob- 
jects is ~ 40%. This fraction of contaminants is consistent 
with that derived by the Monte Carlo simulations above. 
On the other hand, although we cannot make the same 
test to the remaining faint LAEs, we find that no object 
fainter than i' = 26 violates clearly (i.e., above 2a levels) 
the criterion, V — i' > 1.8. From these tests, we conclude 
that statistical properties of LAEs can be reliably derived 
from our sample. 

4. LUMINOSITY FUNCTIONS 

We derive the luminosity function (LF) of LAEs in Lya 
and UV (rest-frame 1700 A) luminosities, assuming that 
the surveyed volume is approximated by the box with the 
cross section of surveyed area and the depth correspond- 
ing to the NB71V& band width (i.e., FWHM). Figures 
4a and 4b plot the Lya LF and UV LF, together with 
those of z = 3.4 LAEs by Cowie & Hu (1998). Cowie 
& Hu (1998) selected all objects with observed equiva- 
lent width of EW ohs > 77A {EW rest > 17.5A in the 
rest frame). Their criterion corresponds to EW b s > 86 
(Ri - NB7U > 0.83) for z = 4.86 LAEs, if the cosmologi- 
cal effects and the difference in absorption by IGM neutral 
hydrogen (Madau 1995) at z = 3.4 and z — 4.86 are taken 
into account. In order to compare the LF at z = 3.4 with 
that at z = 4.86, we make another sample for z = 4.86 
LAEs which is selected by the same criterion as of Cowie 
& Hu (1998) (Ri - NB711 > 0.83) from our all detected 
objects. We find that 234 objects satisfy this criterion. 
We show the LFs of these 234 objects by inverse open 
triangles in Figure 4. These LFs are not corrected for the 
sample contamination or completeness, and they are prob- 
ably contaminated by low-z emission-line galaxies, similar 
to Cowie & Hu's (1998) LF for z = 3.4 LAEs. Both LFs 
decline at the faint end due to incompleteness, which is 
not corrected. 

In Figure 4a, we calculate the Lya luminosity from 
Ri — NB711 color and Ri magnitude, correcting for the 
absorption by neutral hydrogen in IGM. A similar correc- 
tion has been made to the z = 3.4 LAE. Figure 4a shows 
that the Lya LF at z = 4.86 is very similar to that at 
z = 3.4. No clear evolution is found between z = 3.4 and 
z = 4.86 within a factor 2-3. Note that both Lya LFs 
are likely to be highly contaminated by foreground low- 
z emitters. The pure equivalent width selection applied 
to our data (Ri - NB711 > 0.8) finds 234 objects, while 
our color selection finds only 87 objects. This implys that 
as large as 60% of the galaxies contributing to the LF of 
z = 4.86 LAEs in Figure 4a may be contaminants. A sim- 
ilarly large fraction of contaminants may be expected for 
the LF of z = 3.4 LAEs. Thus, an actual uncertainty in 
our finding that no evolution is seen for LAEs between 
z = 3.4 and 4.86 can be within a factor of 2-3, which is 
significantly larger than estimated from Figure 4a. 

In Figure 4b, the 1700 A continuum absolute magni- 
tude Mi 700 is estimated from i' magnitudes 18 . Since the 
z'-band measures the flux at the rest-frame 1300A for a 
z = 4.86 galaxy, we add the median color, TO1700 — i', of 



Zphot = 4.8±0.3 HDF galaxies (—0.04 mag; Furusawa et al. 
2000) to all the i' magnitudes to estimate the magnitude at 
1700A. We calculate the best estimated LF of our original 
87 LAEs satisfying eqs.(l)-(3) (filled squares), correcting 
for the contamination and completeness (section 3). No 
correction is applied to either the LF of z = 3.4 LAEs 
(circles) or that of 234 z — 4.86 LAEs (inverse triangles) 
which are selected by £W bs > 86. The simple criterion, 
EW bs > 86, gives an unrealistically high number density 
of LAEs at Mi 700 < — 21. This is probably due to the con- 
tamination of low- z interlopers because of the lack of the 
selection criterion based on R — i' color. For the reader's 
eye guide, we draw the LFs of LBGs at z ~ 3 (Stcidcl et 
al. 1999) and z ~ 5 (Ouchi et al. in preparation) in Figure 
4b. We find that the bright-end slope of the LF of z = 4.86 
LAEs is steeper than those of z ~ 3 and ~ 5 LBGs. 

Both z = 5 LBGs and z — 4.86 LAEs seem to have a 
similar number density at the faintest magnitudes. How- 
ever, at these magnitudes, the LF of z = 5 LBGs has errors 
of a factor of 1.5-2, and the amplitude of the LF of LAEs 
may have an offset of a factor of two or more due to un- 
certainties in the estimation of contamination, complete- 
ness and the surveyed volume. Hence, we cannot conclude 
clearly that LAEs constitute a majority of high-rcdshift 
galaxies at these faint magnitudes. This is why we discuss 
only the relative shape of the LF between z — 5 LBGs 
and z = 4.86 LAEs. We think that there exists one pos- 
sibility that alters the shape of our LAE LF. We correct 
the completeness, assuming that the distribution of EW 
is the same irrespective of magnitude. If, however, faint 
LAEs tend to have weak EWs, our completeness-corrected 
number density will be overestimated. This may make the 
apparent shape of the LF steeper. 

5. CLUSTERING PROPERTIES 

Figure 5 shows the sky distribution of the z = 4.86 
LAEs in our sample. We find in this figure an inhomoge- 
neous distribution of the LAEs. Prior going to investigate 
the clustering properties of LAEs, we examine the spatial 
homogeneity of our data. We find that the photomet- 
ric zero points of our data are accurate within 0.1 mag 
over the whole field of view, since we find that PSF-like 
objects make a single sharp stellar locus in the two-color 
(R-NB711vs. NB711-i') plane. Then we examine pos- 
sible spatial differences in the source detection efficiency 
by (1) examining the number densities of A_B711-band de- 
tected objects in small (10' x 10') areas covering the sur- 
vey region, (2) measuring the limiting magnitudes in 2700 
small (40" x 40") areas for each of the R, i', and NB711 
images, and (3) estimating the detection completeness of 
LAEs from Monte-Carlo simulations in the same manner 
as in Ouchi et al. (2001a) but assuming model LAE spec- 
tra (see caption of Figure 3). We find no inhomogencity 
in (l)-(3), which indicates that the detection efficiency is 
uniform at least on 40" scales. 

We derive the angular two-point correlation function 
u(6) using the estimator defined by Landy & Szalay 
(1993). The random sample for the estimator is com- 
posed of 100,000 sources with the same geometrical con- 



18 Most of the LAEs have PSF-like (FWHM= 0".9) shapes. If the fluxes of PSF objects are measured with a 1".8 circular aperture, they 
are fainter than the total magnitudes by 0.2mag. When deriving the luminosity function in Figure 4, we adopt m(l."8) — 0.2 as the total 
magnitude of a LAE. 
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straints as of the data sample. We fit a single power law, 
u>(9) = A^O^P , to the data points, but the best fit value 
of (3 is very shallow (J3 = 0.1). This value is much smaller 
than the best fit values of the local galaxies,/? ~ 0.8, and 
z = 3-4 LBGs, 13 ~ 0.3-1.2 (Giavalisco et al. 1998; Gi- 
avalisco & Dickinson 2001; Porciani & Giavalisco 2002). 
We think that the (3 value cannot be determined with an 
enough accuracy from our data, and fix (3 to the 'fiducial' 
value, (3 — 0.8. We fit A u alone to the data with a fixed 
slope, (3 = 0.8, then the best-fit value of A w is 29 arcsec 8 . 
The integral constant (IC) for (3 = 0.8 is calculated to be 
0.195. The resulting angular correlation function for the 
LAEs is shown in Figure 6 after the application of the IC. 
We find that the reduced x 2 value of this (3 — 0.8 fitting, 
6.7, is 1.9 times larger than that for the two-parameter 
fitting, X 2 /N = 3.5. Although the \ 2 fitting with (3 = 0.8 
is worse than the one with (3 = 0.1, we cannot accurately 
derive (3 from our data in any case. Thus we decide to cal- 
culate A w at (3 = 0.8. We calculate the angular correlation 
function under ~ 15 arcmin scales, since systematic errors 
increase largely over ^15 arcmin scales, which are com- 
parable to a half of the surveyed field of view. However, 
we find that the sky distribution of LAEs (Figure 5) has a 
large gradient in the number density from the north to the 
south. This may imply the existence of a large-scale struc- 
ture whose scale could be over 15 arcmin (~ 20ft _1 Mpc). 
An excess of the angular correlation function (Figure 6) 
over the power law at around 300" will be (at least partly) 
due to this large-scale structure. 

In order to investigate the dependence of clustering 
amplitude on physical properties of LAEs, we calculate 
the angular correlation function by dividing the 87 LAEs 
into two sub-samples based on three properties; Lya lu- 
minosity, UV magnitude, and observed equivalent width 
(EW bs)- For each of the three properties, we divide the 
original sample at an appropriate boundary in order to 
keep a reasonable number of objects in each of the sub- 
samples. Figure 7a shows the results when the LAE sam- 
ple is divided by Lya luminosity, logLL ya > 42.2 (30 ob- 
jects : filled circles) and logLL ya < 42.2 (57 objects : 
open circles). Figures 7b and 7c are the same plots, but 
divided by UV magnitudes (Mi 700 > —19.4 [30 objects: 
filled circles], Mi 700 < —19.4 [57 objects: open circles]) 
and by EW obs ( EW obs > 270A [30 objects: filled circles], 
EW bs < 270A [57 objects: open circles]). The correlation 
amplitude of the Lya-bright sample is significantly larger 
than that of the Lya-faint sample. On the other hand, 
such a significant difference is not found in either UV- 
magnitude sub-samples or EW \, S sub-samples 19 . Since 
the Lya luminosity is estimated from the narrow-band 
magnitude, the Lya-bright sample may be biased toward 
LAEs whose Lya emissions are efficiently detected around 
the center of the NB711 band, resulting in Lya-bright ob- 



jects are distributed in a smaller rcdshift range than Lya- 
faint objects. A smaller redshift distribution gives stronger 
angular correlation. If this is the case, however, a similar 
effect should also be seen in the £W b s -dependent corre- 
lation function. We do not see such effect in the £W bs 
sub-samples. Different degrees of contamination of low- 
z interlopers in the two Lya sub-samples could cause a 
segregation in correlation amplitude. In Figure 7a, the 
difference in correlation amplitude in the sub-samples is 
about a factor of two. If the Lya segregation is solely 
due to the contamination, the two sub-samples must have 
largely different degrees of contamination by more than 
a factor of two. Since such a large magnitude-dependent 
contamination is not found in the Monte Carlo simulations 
(section 3), the contamination docs not seem to cause the 
Lya-luminosity segregation. We therefore conclude that 
the difference in the correlation amplitude between the 
Lya sub-samples is probably real. 

6. DISCUSSION & CONCLUSIONS 

The LFs of LAEs show little evolution between z = 3.4 
and z = 4.86 either for Lya emission or UV continuum 
emission ( Figures 4a and 4b). Both Lya luminosity and 
UV-continuum luminosity are sensitive to star-formation 
activities and extinction by shading HII regions. In ad- 
dition, Lya luminosity is dependent on gas density and 
dust composition in HII regions, since the Lya photons 
are produced by a number of the resonance scatterings in 
HII regions. Therefore, little evolution of the LAE LF 
between z — 3.4 and 4.86 may imply that z = 3.4 and 
z = 4.86 LAEs have similar gas densities and dust com- 
ponents in their HII regions, unless the number density of 
LAE is largely changed. 

Figure 4b shows that the LF of LAEs at z — 4.86 mea- 
sured in UV continuum seems to be steeper in the bright 
end than the LF of LBGs at similar redshifts, indicating 
that galaxies with a stronger Lya emission tend to be less 
luminous in UV continuum. Shapley et al. (2001) have 
found that z = 3 LBGs with old stellar populations emit a 
stronger Lya emission than those with young stellar pop- 
ulations. 20 A combination of these two findings suggests 
that galaxies less luminous in UV continuum are on the 
average older. If we assume here that UV-continuum lu- 
minosity correlates positively with the stellar mass, the 
suggestion above implies that less massive galaxies tend 
to be older, which is qualitatively consistent with a hier- 
archical merging scenario such as CDM models. 

We find a clear clustering signal of the LAEs at z = 
4.86 ±0.03. The amplitude of angular correlation function 
(Figure 6) is A^j — 29 arcsec 1 , and it is about 40 times 
larger than that of LBGs at z — 3.8±0.5 (Ouchi et al. 
2001a), A^ = 0.71 arcsec 8 . However, since the selection 
function in the direction of redshift of the LAE sample is 

19 We make similar analyses, varying the boundaries of Lya luminosity, UV magnitude, and _BW b s , but keeping the number ratio of objects 
in the two sub-samples (e.g., Lya bright and Lya faint sub-samples) being in an appropriate range, 3:7 to 7:3. We find clear dependence of 
clustering amplitude on Lya luminosity in a wide range of the number ratio, but find no such significant dependence in either UV-magnitudc 
sub-samples or -EW b s sub-samples. 

20 Malhotra & Rhoads (2002) have argued on the basis of the distribution of Lya equivalent width in their LAE sample that the LAEs are 
predominantly quite young. Thus, the age of LAEs appears to be still under debate. However, these two papers may have estimated ages of 
different populations (Of course, differences in the sample selection may also be a reason for the inconsistency). The result of Malhotra & 
Rhoads (2002) would be for the stellar age of star-forming regions in LAEs, since they estimate the age from the rest-frame UV flux to which 
no old star contributes. On the other hand, Shapley ct al. (2001) calculate the averaged (luminosity weighted) stellar age from the combination 
of the rest-frame UV and the rest-frame optical flux, by taking advantage of their near-infrared data. Since we discuss the averaged feature of 
LAEs, wc use here Shapley et al.'s result. 
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about 20 times narrower than that of LBGs, the clustering 
amplitude of z = 4.86 LAE in the real space is found to 
be comparable to that of z ~ 4 LBGs as described below. 

The clustering amplitude can be translated into the cor- 
relation length using Limber equation, given the redshift 
distribution of the sample. Assuming that the redshift dis- 
tribution of the LAEs is a tophat shape of z = 4.86 ±0.03, 
we estimate the correlation length, r , of the LAEs to 
be ro = 2>.^t°Q%h~ 1 Mpc 21 . Foreground contaminations 
to the sample dilute an apparent clustering amplitude of 
LAEs. When the fraction of contaminants is /, the appar- 
ent value can be reduced by a factor of up to (1 — f) 2 ; 
the maximum reduction occurs when the contaminants are 
not at all clustered. In reality, the contaminants in our 
sample will be a sum of emission-line galaxies at several 
rcdshifts, and thus would be clustered very weakly on the 
sky. If we assume that / is 40% for our LAE sample (see 
section 3) and that contaminants are not clustered, we 
obtain the contamination-corrected correlation length to 
be r = 6.2to;5^~ 1 Mpc. This is the maximum r value 
permitted. 

These raw and contamination-corrected values of r 
are larger than that of z ~ 4 LBGs obtained in Ouchi 
et al. (2001a); r = 2.7± 1 ;g/i~ 1 Mpc for the raw value 

and ro = 3.3+ ' 7 /i _1 Mpc for the contamination-corrected 
value. The mean UV luminosity of LAEs in this study is 
fainter than that of z ~ 4 LBGs studied in Ouchi et al. 
(2001a), since our LAE sample includes galaxies down to 
— 18.5 mag, which is ~ 1.5 mag fainter than the faintest 
galaxy in Ouchi et al.'s (2001a) LBG sample. Giavalisco & 
Dickinson (2001) have found in their z ~ 3 LBGs that ro 
increases with the UV luminosity. If this holds for LBGs 
at z ~ 4 and LAEs at z = 4.86, our LAE sample should 
give a smaller value of ro than Ouchi et al.'s (2001a) LBG 
sample. However, no such trend is seen; the ro of z = 4.86 
LAEs is even larger than that of z ~ 4 LBGs. This may 
imply that z = 4.86 LAEs have a higher biasing factor 
against the underlying dark matter than z ~ 4 LBGs. 
(In this discussion, we assume that clustering properties 
of galaxies do not significantly evolve from z = 4.86 to 
z ~ 4) . The general trend that ro increases with halo mass 
may not necessarily hold for LAEs, since their clustering 



might be 'enhanced' due to, say, unknown evironmcntal 
effects which produce galaxies with strong Lya emission 
lines. However, we cannot rule out at present the possi- 
bility that the dark halo masses of LAEs are higher than 
our expectations from their luminosities. 

The LAEs in our sample have nearly the same dynamic 
range both in Lya luminosity (41.85 < log£/Lya 

< 42.65 

) and in UV-continuum luminosity (M1700 = —18.5 to 
—20.5). Figure 7 shows, however, that the difference of 
clustering amplitude is seen not for UV sub-samples but 
only for Lya sub-samples. Hence the degree of clustering is 
probably more strongly dependent on Lya luminosity than 
UV-continuum luminosity. This result is consistent with 
the fact found above that z — 4.86 LAEs show stronger 
clustering amplitude than z ~ 5 LBGs in spite of the for- 
mer being fainter in UV-continuum luminosity. 

Shapley et al. (2001) have found in their z ~ 3 LBG 
sample that older LBGs (in terms of mean stellar age) 
have a stronger Lya emission. If this is also the case for 
LAEs, LAEs with a stronger Lya emission will be older 
on the average. This is consistent with our finding that 
LAEs more luminous in Lya emission are more strongly 
clustered, if we assume that the biasing factor is higher for 
older galaxies. 

We have found that LAEs dominate at the fainter part 
of the UV LF of galaxies at z ~ 5. We have also found a 
clear clustering signal in our z = 4.86 LAE sample. Pas- 
carelle, Windhorst, Keel, & Odewahn (1996) have made 
the hypothesis, from their findings of z = 2.4 LAEs being 
compact, that LAEs may be sub-galactic clumps located 
in groups or sheets of collapsed dark matter. Our two 
findings seem to be consistent with the hypothesis. 
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Fig. 1. — (a)Transmittance of the ./V.B711(solid line), R, and i' bands (dotted lines). (b)SEDs of 87 z=4.86 LAEs. Each solid line corresponds 
to the SED of a LAE. B,V,R, NB7U, i' , and z' magnitudes are simply connected after normalized so that i' is equal to 0. 
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NB711 

Fig. 2. — Distribution of all the detected objects in the Ri' — NB711 vs. NB711 plane, where Ri = (R + i')/2. Red solid (dashed) lines 
indicate the distribution of 3<t(1<t) errors in brightness for a source with a fiat (f v =const) spectrum. Blue lines show the detection limits of 
NB711 and Ri, and the pink line indicates our selection criterion on Ri — NB7U color. 7ViJ711-band detected objects with no continuum 
emission («' > 28.1) are shown just above the blue line. Red filled circles are our photometrically selected z = 4.86 LAEs which satisfy all the 
criteria (see text). The yellow line indicates the selection criterion for the absorbers defined in section 3. 
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R - i' R — i ; 

Fig. 3. — Two color diagrams for continuum color (R — i 1 ) and narrow-band excess color (Ri — NB711), where Ri is a continuum magnitude, 
Ri = (R + i)/2. (left panel) Tracks of model galaxies at different redshifts. Red lines indicate model LAE SEDs which are composite spectra 
of a 0.03 Gyr single burst model galaxy (GISSEL96;Bruzual & Chariot 1993) and a Lyman a emission ( £Wrcst(Ly»)=22 A); from the left 
to right, three different amplitudes of IGM absorption are applied: 0.5r c ff, r e g , and 1.5r c ff , where T e g is the Madau's (1995) original median 
opacity. The narrow-band excess in each of the peaks in the red lines indicates the Lyman a emission of LAEs at z = 4.86. Green lines 
show 6 templates of nearby starburst galaxies (Kinney et al. 1996) up to z = 1.2, which are 6 classes of starburst galaxies with different dust 
extinction (E(B — V) = 0.0 — 0.7). The narrow-band excess peaks in the green line of the starbursts correspond to the emission lines of 
Ha (z = 0.08), [OIII](z = 0.4), H/3(z = 0.5), or [Oil] (2 = 0.9). Two blue lines indicate the tracks for model LBG SEDs without Lyman a 
emission, for 0.5T e g, T e g, respectively. Black lines show colors of typical elliptical, spiral, and irregular galaxies (Coleman, Wu, & Weedman 
1980) which are redshifted from 2 = to 2 = 2. Yellow star marks show 175 Galactic stars given by Gunn & Stryker (1983), and 24 Kurucz 
model stars some of which show absorption features at around 7100A. The pink box surrounding the upper right region is the selection criteria 
of our 2 = 4.86 LAEs. (right panel) Colors of the detected objects. The red circles indicate our LAEs, while the black dots are the other 
objects. All objects satisfying the z~5 LBG selection (Ouchi et al. in preparation) are indicated by blue open circles. Yellow circles are 37 
possible absorption objects denned in section 3. The black open circle denotes the median color of our 87 LAEs, and the amplitudes of its 
error bars indicate the median photometric errors in the LAEs. Our LAE selection criteria are also shown by pink lines. 
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Fig. 4. — (a) Luminosity functions (LFs) of LAEs in Lya luminosity. Circles are for z = 3.4 LAEs with EWrest > 17. 5A selected by Cowie 
& Hu (1998). Inverse triangles arc the LF for z = 4.86 LAEs which are selected from our data with the same criteria as for the z = 3.4 
LAEs. (b)LFs of LAEs and LBGs in UV magnitude. Filled squares are the best estimated LF for z = 4.86 LAEs with EW Ics t > 14A. 
The dotted line is the best fit Schechter function to z = 4.86 LAEs (with a fixed slope: a = —1.6). The meaning of open circles and 
open inverse triangles is the same as in (a). The LF for z = 3.4 LAEs , shown by inverse triangles, is probably contaminated by low-z 
emission-line galaxies, similar to Cowie & Hu's (1998) LF. Solid and dashed lines are LFs of LBGs at z ~ 5 (Ouchi et al. in preparation) 
and z ~ 3 (Stcidcl ct al. (1999)), respectively. The x axes of (a) and (b) are marked in star-formation rate (SFR). The SFR in panel (a) is 
estimated from Lya luminosity; Lya luminosity is converted into Ha luminosity under the case B approximation (Ha=Lya/8.7; Brocklehurst 
1971) and the Ha luminosity is translated into star-formation rate by the relation, SFRQsAQ-yr^ 1 ) = Lu (erg s — 1 )/(1.41 X 10 41 ), given in 
Madau, Pozzctti, & Dickinson (1998). The star-formation rate in panel (b) is estimated from UV-continuum luminosity with the relation, 
SF^Meyr" 1 ) = L uv (erg s- 1 Hz" 1 )/(8.0 X 10 27 ). These SFRs are not corrected for dust extinction. 
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Fig. 5. — Sky distribution of the photometrically selected z = 4.86 LAEs. Different sizes of circles correspond to different magnitude bins 
defined in the panel. North is up and cast is to the left. 
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Fig. 6. — Angular correlation function for the 87 LAEs. The solid line shows the best fit power law with u>(0) = A^9 8 over the whole 
range. The reduced \ 2 of the fitting is 6.7. 



14 



Ouchi et al. 



i i i i rn 



"3 



"3 



1 1 1 1 1 

/ \ T 

(a Jhya 



0.1 



0.1 E 



0.1 




100 



1000 



9( arcsec 



Fig. 7. — Angular correlation functions for the sub-samples of 87 z = 4.86 LAEs. (a) Lya luminosity-dependent angular correlation 
functions. Filled circles are for the Lyo-bright (logLL yC( > 42.2) sample, while open circles are for the Ly«-faint (logLL yC( < 42.2 ) sample. 
Dots indicate the angular correlation function of the whole 87 LAEs shown in Figure 6. The filled (open) circles are shifted by 0.03dcx 
(— 0.03dcx) along the abscissa for clarity, (b) Same as (a), but for UV-continuum luminosity. Filled circles are for the UV-continuum bright ( 
Mnoo < —19) sample, and open circles are for the UV-continuum faint (M1700 < —19 ) sample, (c) Same as (a), but for observed equivalent 
width (-EWobs) of Lya emission. Filled circles are for the EW \> a large ( EW obs > 270A) sample, and open circles are for the EW obs small ( 
EW obB < 270A) sample. 



